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LEAST  SQUARES  OVER  THE  COMPLEX  FIELD 


1.  Introduction 

Sets  of  complex  linear  (observational)  equations  in  s £ r unknowns 
•rise  in  ballistics.  For  the  equivalent  real  equations  the  least  square 
solution  I3  frequently  accomplished  by  the  square  root  method.  This  method 
has  several  characteristics  which  recommend  it  for  use  with  high  speed 
computing  machinery: 

(1)  In  fixed  decimal  machines  the  scaling  problem  tends  to  b® 
minimized  because  the  square  root  operation  reduces  the  spread  of  data. 

(2)  Tne  algoritras  involved  are  particularly  simple  and  independent 
of  the  number  of  unknowns.  (This  implies  that  to  extend  a set  of  instruc- 
tions for  solving  an  nth  order  system  to  a larger  system  requires  only 
adding  instructions.) 

(3)  Storage  allotment  is  systematic  and  simple. 

(4)  The  amount  of  storage  required  (at  least  with  certain  machines) ^ 
appears  to  be  minimal . 

(5)  A simple  simultaneous  check  cf  th*  formation  and  solution  of 

the  normal  equations  and  calculation  of  residuals  is  possible  (cf.  theorem  3)* 

(2) 

(6)  Weights'  1 of  the  unknowns  are  readily  calculated  from  inter- 
mediate results. 

It  ie  not  appreciated  in  all  computing  circles  that  the  square  root 
technique  admits  of  a trivial  extension  to  the  complex  domain  maintaining 
the  characteristics  mentioned  above.  Cnee  this  is  appreciated  it  is 
natural  to  ask  whether  there  is  "any  difference"  in  solving  the  complex 
normal  equations  by  computing  with  complex  numbers  or  by  computing  with 


The  program  constructed  at  NQL  for  use  on  a Card  Programmed 
Calculator  using  a double  operation  general  purpose  board  requires  no 
temporary  storage.  The  storage  requirement  for  solving  a system  of  n 
equations  with  n unknowns  Is  one  more  than  the  number  of  (in  general 
distinct)  elements  in  the 
ment  is  ^(n®l)(n®2). 


(augn anted)  matrix,  i.e. , the  storage  require- 


(2) 


See  Whittaker  and  Robinson, 


Edition,  p.  239. 


Calculus  of  Observations, 


Third 
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real  numbers.  It  turns  out  that  the  number  of  real  operations  (of  each 
type)  required  to  solve  the  normal  equations  by  computing  within  the  com- 
plex domain  is  less  than  or  equal  to  half  the  nunber  of  real  operations 
required  to  solve  the  equations  by  computing  within  the  real  domain. 


2.  The  problem 

Let  M ■’>  N ♦ IP  be  a complex  r x s matrix,  s £ r.  Let  w • u ♦ iv 
be  a complex  r x 1 matrix  (or  column  vector).  The  problem,  then,  is  to 
find  a complex  s x 1 matrix,  z ■ x ♦ iy,  which,  in  the  leaet  square 
sense,  is  the  best  possible  solution  to  the  set  of  equations 


(1)  Ms  * w. 

("l"  denotes  "equals  approximately"  and  ie  used  to  emphasise  that  there 
exists,  in  general,  no  z such  that  Hz  - w precisely.) 
from  (1)  we  obtain 

(N  ♦ iP)(x  ♦ iy)  * u ♦ iv 


(Nx  - Py)  ♦ i(Px  ♦ Ny)  4 u * iv 

so  that 

/' x\ 

(2)  Nx  - Fy  ■ u or  (N  -?)  y j » u 

and 

/ x \ 

(3)  Px  ♦ Ny  4 ▼ or  (F  K) ^ J.  * v. 

Equations  (2)  and  (3)  taken  together  yield 


(4) 


The  two  methods 


(3) 


of  solving  (1)  with  which  we  are  familiar  both  seek 


references  4 and  6. 
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the  solution  of  (4). 

3.  The  mapping 

We  note  that  ( 2 ) and  (3)  are  respectively  equivalent  to 


(P 


u 


(N 


-v 


and  the—  letter  taken  together  are  equivalent  to 


\ y / 


(s  -e\(-A  t (A 
Vp  n y 1 * / v J' 


(it)  and  (5)  are  equivalent  and  each  is  equivalent  to 


Let  f denote  the  mapping 

f(M) 

Than  (6)  may  be  written 


/N 

1 

-p\ 

< - 

\ r 

) 

H J 

for  any  complex  matrix  M. 


f(M)-f(a)  * f(w). 


4.  Some  theorems 

Theorem  1,  For  any  z « x * iy  the  sum  of  the  squares  of  the  moduli 
cf  the  residuals  of  (1)  equals  the  sura  of  the  squares  of  the  residuals  of 
(4). 

Proof.  The  sum  of  the  squares  of  the  residuals  of  (l)  may  be  written 
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in  matrix  terminology  «« 

(7) 


'(Mz  - w)(Mz  - w) 


where  11  A”  denotes  the  transpose  of  the  matrix  A and  A denotes  the  matrix 
obtained  from  A by  replacing  each  element  by  its  conjugate.  [For  1 'I  we 
shall  often  write  *a!J  Replacing  M by  N ♦ iP,  z by  x ♦ iy  and  w by  u ♦ ir 
ws  obtain 

Mz  - w - (Nx  - Py  - u)  ♦ i(Px  ♦ Ky  - v) 

so  that  (7)  becomes 

(8)  ^(Nx  - py  - u) (Nx  - Py  - u)  «•  t(Px  + Ny  - v)(Px  ♦ Ny  - v). 

The  sum  of  the  squares  of  the  residuals  of  (4)  is 

ic  ex;)  • one  do  - 01 


f Nx  - ty  - u\ 

^ Nx  - Py  - u^ 

V Px  ♦ Ny  - ▼/ 

Rx  ♦ Ny  - v/ 

(7), 

which  equals  (8)  and  hence  (7) . 

Lemma  1.  If  A is  a hermitian  positire  definite  matrix,  then  there 
exists  at  most  one  triangular  matrix  5 with  real  positive  diagonal  elements 
such  that  » A.  (S  - (s^j)  ie  triangular  shall  mean  that  5 is  # 

square  matrix  with  the  property  that  i > j implies  s^j  ■ 0.) 

Proof.  Assuming  S exists  we  have  *ki*kj  " aij>  1 “ J - n> 

where  n is  the  order  of  A.  Since  i > J implies  ■ 0,  for  i £ j we  have 
a^j  - 2j^i  •ki*kj<  which  71*lds  the  formulas: 
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'll  * 

^ *1J  * Zt 

, 1 < J $ n, 

i^l  _ 

ij  " 

^AiJ  " ^ *kiakjV*ii' 

1 < i < J £ n 

JJ 

ii  _ i . 

r J J ^k-l  “kJTci  ' 

1 < i - J < n, 

Th coras  2.  The  following  fire  conditions  on  & heraitian  n x n matrix 
A are  equivalent.  [(«}  is  takan  as  the  dafinition  of  a matrix  baing 
positive  definite.] 

(a)  *xAx  > 0 for  all  non- faro  complex  n x 1 matrices  x,^ 

(b)  A - h •B  for  soma  coaiplax  r x s matrix  B and  | A | / 0. 

(a)  The  principal  minors  of  A are  all  positive,  i.a. , the  determinants 
of  all  matrices  obtained  from  A by  delating  the  same  rows  and  columns  arc 
all  positive.  ( | A | is  a principal  minor.) 

(d)  A • ^3*8  for  a complex  triangular  matrix  S - (s^)  with 
positive  diagonal  elements. 

(a)  Let  A^,  1 £ i < n,  denote  the  matrix  obtained  from  A by  deleting 
row*  and  columns  i ♦ 1,  i ♦ 2,  ••*,».  |A^|  > 0 for  1 £ i < n and  |a|  >0. 

Proof,  (a)  impliae  (s).  Let  A^,  A^,  V.  b*  not  necessarily 
distinct  roots  (eigenvalues)  of  g(A)  • |A  - Al|,  so  that  g(A)  - 
TT^  - A).  Then  g(C)  “ |a|  • A^.  For  each  A^  there  exists 

a noa-sero  n-tuple  (column  vector,  eigenvector)  x^  such  that  Ax^  “ A^x^, 

since  there  exists  a non-trivial  (non-sere)  solution  to  ths  equations 

^For  any  hermit, i an  A,  %Ax  • ^xTjc  - ^(Scax)  * tjx^Ix  - “xAx 
so  that  *xAx  is  real. 
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(A  - >..l)x  » 0.  Uaine  the  hypothesis:  V*Ax„  * V'K.x.  -J 

i “ a i ill 

*±\\  > G»  oo  that  > o.  Hence  jA  j - TT^  \ > 0. 

Let  A(i)  denote  the  matrix  obtained  from  A by  deleting  the  ith  row 
and  colxmm  and  x(i)  the  column  matrix  obtained  from  the  n x 1 matrix  x 
bjr  deleting  the  ith  el  ament  (row).  If  the  ith  mw  of  x is  ro,  then 

^xAx  - Vi)  A(l)  x(i). 


so  that  A(i)  ie  positive  definite.  FTem  the  preceding  paragraph, 
jA(i)|  > 0.  It  follows  that  all  principal  minora  are  positive. 

(o)  Implies  (e).  Obvious. 

(e)  implies  (d).  {A^J  - a^  > 0,  so  that  there  axlot*  • 

fa^7  *nd  *i2  " *12/*!]  * If  *2 2 “ *12*12  > °*  th*n  **  °*n  find 
«22  > 0 and  e^,  e„  satisfying  (?)  above.  If,  further,  n^  - S^n, . - 

*23*23  > °*  th#c  w*  can  fljn<1  *33  > *2 4*  *34  sMrtiafyiaf  (*) 

above.  Let  r denete  the  least  j such  that 

(10)  ^ Vj"kj  * ° 

(assuming  there  exists  suoh  a J,  1 < J 5 n).  Let  l tfOb*  suoh  that 

IT 

2 c1 . 

**rr  " *rr  * §,  *kr*ta' 


Denoting  the  triangular  matrix  (s.  «)■,  4 4 . . ..  by  S„  we  have 

xj  a j x,  j t r r 


? *S  » A 

r r r 


where  Sf  is  *S  except  in  the  rth  row  end  column  stands  -a^,  instead  of 


IV  " 


-Tf 


®11* 
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so  that 


r 

-IT 

i-i 


sii* 


The  left-hand  member  is  positive  by  hypothesis,  while  the  right-hand 
member  is  negative  or  zero.  Thus  the  assumption  of  the  existence  of  j, 

1 < J £ n,  such  that  (10)  holds  is  false,  and  the  existence  of  S is 

• 4 a V>  «k/4 

va  Ul»  V.4.A  W>1  wv«  • 

(d)  implies  (b).  Take  B - S,  |Aj  > 0 since  f A | - TTj^i  8ii 

and  > 0- 

(b)  implies  (a),  ScAx  - - ^x^5*Bx  - ^(Bx)Bx  £ 0 

since  ^(EbOBx  is  a sura  of  squares.  If,  for  some  x,  ^(Bx)Ebc  - 0,  then 
Bx  - 0.  Hence  ^S»Bx  - Ax  - 0.  | A | / 0 and  Ax  - 0 imply  x - 0 (this 
follows  from  Cramer's  rule). 


Corollary.  If  A is  hermitian  positive  definite,  then  there  exists 
a unique  triangular  matrix  with  positive  diagonal  elements  such  that 

A - t2*3. 


Proof.  Immediate  from  lemma  1 and  theorem  2. 

Lemma  2.  If  the  sum  (product)  of  two  complex  matrices  M^,  is 
defined,  thsn  the  sum  (product)  of  the  two  real  matrices  f(K^),  ^(Mj) 
is  defined  ,ind 

(a)  fl.Kj.  ♦ Mg)  - r<M1)  ♦ fO^), 

(b)  fCM^itg)  - rCa^-fO^), 

(c)  f(aM)  - af(K)  for  any  real  number  a. 

Proof.  That  the  sum  and  product  of  f(M,),  f(K,)  are  defined  is  clear. 
Proofs  cf  (a)  and  (c)  are  obvisus. 
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(b)  Let  Mi  - Nx  ♦ iPL,  - N2  ♦ iPg.  Then 


- 

Remark.  An  n x ft  matrix  A i«  called  non-singular  if  A *'1  exists. 

A~^  exists  if  and  only  if  | A { / 0 since  (1)  if  A-^  exists,  A*A-^  - I, 

| A | - |A_1|  ■ lj  so  that  t A ] / 0,  and  (2)  if  j A [ / 0,  then  Ab^  - 
1 5 i - n,  fixed  j,  has  a solution  by  Cramer's  rule;  let  J vary  between 
1 and  n,  then  if  B « (b^)  , A5  • I. 

Lemma  3.  (a)  f(l  ) « I-  . where  I denotes  the  n x n identity 

n xn  n 

matrix. 

(b)  If  M is  a square  matrix  and  exists,  than  f(M)  is  square, 

[f(M)]"1  exists,  and  f(K_1)  - if(M)]"1. 

(c)  f(^R)  - tf(M). 

(d)  H • P ♦ iQ  is  heraitian  if  and  only  if  P is  symmetric  and 
Q is  akew-eynnnetrlc. 

(e)  If  H is  heraitian  positive  definite,  then  f(H)  is  symmetric 
positive  definite  and  if  H • P ♦ iQ  then  P ie  positive  definite. 

Proof,  (a)  follows  from  the  definition  of  f. 

(b) .  If  AM  - I,  then  f(A)*f(M)  - I using  lasma  2(b)  and  lemma  3(e). 

Thus  f(A)  - (f(K))"1  if  A - M_1. 

(c) .  If  H ■ N ♦ IP,  *M  ■ h - th, 
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f(M) 


f(*M) 


fS 

v«tp  s J 1 


and  the  result  follows. 

(d).  Immediate  from  the  definition  of  hermitian. 

(•).  By  the  corollary  to  theorem  2 there  exists  a triangular  matrix 
3 such  that  *S*S  • H.  Applying  f to  both  sides  of  this  equality  yields 

f(*S)*f(S)  - f(H). 

E|y  lemma  3(c),  f(*S)  - tf(S),  so  that 

(A)  tf(S)-f(S)  - f(K), 


and 

(B)  ^(H)  - V^Sj^fCS)]  - f(H). 

(B)  shows  that  f(H)  is  symmetric.  That  |f(H)|  / 0^  iollows  from 

lemma  3(«).  |f(H)|  0 and  (A)  prove  that  f(H)  is  positive  definite 

(over  the  complex  numbers)  by  theorem  2. 

Alternativsly,  f(H)  may  be  proved  symmetric  positive  definite  as 
follows.  f(H)  - ^ “pj  . From  (d),  f(H)  is  symmetric.  Since  H is 
positive  definite, 

ttHa  = a(s)  > 0, 


tt{%)  f(H)  f(») 


a(«)  0 \ 

. 0 a (.)/ 


(5) 


Indeed,  it  may  be  shown  that  |f(H)J  - |H|‘ 
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where  z ■ x ♦ iy.  It  follows  that 

<**  V)  f(H)  - a(z)  > 0.(6) 

Let  S • U ♦ IV,  Thor. 


It  follows  that  P ■ ^U*U.  U is  triangular  and  the  elements  along  ita 

main  diagonal  are  the  elements  along  the  main  diagonal  of  3.  Thus 
J U | «*  |S|  / 0.  Therefore,  P is  positive  definite. 

Theorem  3.  Assuming  |*M*M|  ^ 0,  ' che  ■ which  minimizes  the  sum 

of  the  squares  of  the  moduli  of  the  residuals  of  (l)  is  ths  solution 
to  the  equation 

(11)  - *H-w. 

Proof.  Since  |*M« Mj  / 0,  it  follows  that  |f(*M*H)|  / C from 

lemma  3(h).  By  theorem  1,  if  is  the  least  square  solution  to  (4) , 

than  z = x ♦ iy  minimizes  the  sura  of  the  squares  of  the  moduli  of  the 
residuals  of  (1).  The  least  square  solution  to  (4)  ie  the  solution  to 
the  equation 

(12) 

\ y / \ V ' 


^ ^This  latter  proof  shows  that  f(H)  is  positive  definite  over  the 
real  numbers.  It  may  readily  be  shown  that  in  general  if  a symmetric 
matrix  is  positive  definite  over  the  real  numbers,  it  is  positive  definite 
over  the  complex  numbers. 

^^If  M is  an  r x s matrix,  s £ r,  of  rank  s,  it  may  be  shown  that 
j *M*  M j / 0. 


10 


NAVORD  Report  3797 


Application  of  f to  (11)  yields 

(13)  *'f(M)*f(M)*f(z)  - ^(mJ-mw). 

The  first  column  of  f(z)  is  then  the  solution  to  (12)  and  the  theorem 
is  proved. 

Theorem  4.  Let  Ax  - g represent  a set  of  n linear  equations  in  n 
unknowns.  Assume  A is  an  n x n hemitian  positive  definite  matrix  and 
g is  an  n x 1 complex  matrix.  Then 

f A -g\ 

(a)  there  exists  a such  that  if  B » ( . ),  then  1 3 1 •=  j A j 

\-  g a / 

(b)  there  exist  an  n x n triangular  matrix  S and  an  n x 1 matrix  k 
such  that 

/a  -8n  _ /*  oys  -y; 

V-1?  a)  V-^  l/Vo  1 J 

(c)  there  exist  an  n x n triangular  matrix  T and  an  n x 1 matrix  y 
such  that 


/n  » n 

( T 

'V s 

n « <1  a»  v 

. / 1 °V 

l \»f\ 

\ ° 

"1  A-o 

‘A 

1 V»n  \rnx  I 

\ 0 1/ 

(d)  Ay  - g. 

Proof.  Expand  |B|  by  elements  of  the  last  column,  giving  |s|  - 

c ♦ |A|a  where  c is  independent  of  a,  i.e.,  |B|  is  a linear  function  of  a. 
Since  (A [ / 0,  a can  be  determined  so  that  | B | • (a|. 

Since  |B|  - { A ] > 0,  and  A is  positive  definite,  it  follows  from 

theorem  2,  condition  (e)  that  B is  positive  definite.  Qy  the  corollary 
to  theorem  2,  there  exists  a unique  (r.+l)  x (n+1)  triangular  matrix  which 
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decomposes  S (in  ths  sense  of  the  corollary).  Since  |b|/|a|  equals  the 
square  of  the  element  in  the  (n+l)th  row  and  column,  this  element  is  1. 
Thus  B decomposes  as  shown  in  (b). 

Let 


Assume  inductively  that  T is  triangular.  Then  wS  ♦ 0*1  - 0.  Since 

| 3 | / 0,  w ■ 0,  so  that  the  inverse  of  a triangular  matrix  is  triangular, 
(c)  follows. 

Fran  (c),  T(-k)  ♦ y*l  - 0 and  TS  ■ I,  so  that 

y " Tk 

Sy  - STk  «*  k 

lS3y  - 

From  (b),  A - uSs  and  -g  « ^S(-k)  ♦ 0*1,  so  that  (d)  follows. 

Theoran  5.  Let  e - Mz  - w where  M,  w are  as  in  (1)  and  z is  the 
solution  to  (11).  Let  A - *M*M  be  non-singular.  Let  g ■ *M«w,  Let 
A ■ *S«S,  the  unique  triangular  decomposition  given  by  t.he  corollary  to 

theorem  2.  Let  k ■ *S-^  g.  Then 

(li*)  *e,e  » *w»w  - #k»k. 

Proof.  *«•  e - *z*MMz  - *wM*z  - *z  ■*Mw  *ww  - *z**SSz  - *gz  - 
«zg  ♦ *ww  _ *zg  - *gz  - *zg  ♦ *ww  ■ *ww  - *gz.  Now  Sz  ■ k,  so  that 

* - k,  while  *Sk  » g,  so  that  *g  - *kS.  (L+)  follows. 

5.  Weights 

Let  A bo  a non-singular  s x s matrix.  If  (j^),  k “ 1*2, •••,»,  is 
the  solution  of  the  real  matrix  equation 
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(15) 


Ax  - g, 


.(8) 


then  the  weight'  ' of  the  solution  x^.,  written  w^Cx)  or  more  properly 


wk(A)>  is  given  by 
(16) 


1 

77T 


V* 


!\l 

iAi 


KH 


where  I A.  I is  the  minor  of  a.,  and  where  ( s.  .) 

X'  • ij 


.-1 


E - A 

“(*k)  * (x^  + iy^),  ^ " 1> 2,  • • • , s,  1®  the  solution  cf  the  complex 


matrix  equation 

(17) 

*nd 

(18) 

then  we  define 
(19) 


JV 


As  - g 


A - B ♦ Ci, 


1*1 


g - m ♦ ni. 


V 


and  we  define  *k(x)  - v^(f(A))  and  wfc(y)  - w^UU)). 

Theorem  6.  If  A is  hermitian,  then  w^s)  " w^x)  * w^y). 

Proof,  Let  A ^ • M ♦ Ni.  Since  A is  hermitian,  A ^ is  also 
(9) 

hermit ian  so  that  N is  skew-symmetric.  Thus 


(20) 


^nr  ■ sk  * “we1  • "w 


It  follows  from  lemma  3(»)  that 


(8) 

' 'Cf.  Whittaker  and  Robinson,  Calculus  of  Observations. 

'^'From  AA-^  » I follows  *A~^**A  “ *(AA-^)  « *1  « I.  A - *A. 
so  that  *A~^*A  • I.  Hence  *A-^  - A-^  and  A*"^  is  hermit ian. 
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so  that 


UGunuinj^  operations 


Theorem  7.  Lst  a(n),  m(n),  d(n)  reprsssnt  the  number  of  reel  additions 

(or  subtractions),  multiplications,  and  divisions,  respectively,  required 

to  find  S such  that  *3*3  - A by  means  of  algorithm  (9)  on  page  5 where 

A is  a real  symmetric  positive  definite  n x n matrix  and  3 is  a triangular 
—1  —1  «-1 

matrix.  Let  a (n),  m (n),  d~~(n)  represent  the  number  of  additions 
(or  subtractions},  multiplications,  and  divisions,  respectively,  required 
to  find  T - S-^  by  means  of  the  formulae  given  below.  Let  *a(n),  **•, 

*a”^(n),  have  corresponding  meanings  in  the  case  that  A Is  a not  real 
hemitian  positive  definite  matrix.  Then 


<A> 


(B) 


a(n) 

ee 

a(n) 

■ a”^(n)  * 

^ n(n2  - 1) 

d(n) 

m 

j n(n 

- 1) 

*~\n) 

m 

z n(n 

- l)(n  - 2) 

d-1(n) 

m 

2 n^n 

♦ 1), 

*a(n) 

m 

■•a(n) 

- *m"*1(n) 

- t n(n  - l)(2n 

p 

m 

J n(n 

- l)(n  - 2) 

*d(n) 

- 

n(n  - 

1) 

*d-1(r.) 

■5 

n2. 

M 
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Proof,  We  establish  the  formulas  for  ra(n)  and  *m(n)  r>nly.  The 
others  may  be  established  in  a similar  manner.  We  give  first  the  formulas 
for  computing  T ■ (t^). 


(21) 


when  i <1. 


The  formula  for  m(n)  is  correct  for  n - 1.  Assume  it  correct  for  n. 

Since  the  number  of  multiplications  required  to  compute  s^  0 < i £ 

1 2 

n+l,  is  i - 1,  m(n  ♦ 1)  - £ n(n  -1)  ♦(0+l*2+»,,+n)  - 

1 2 X X 

n(n  -1)  ♦ ^ n(n*l)  ■ £ n(n*l)(n+2),  which  establishes  the  formula. 
Multiplication  of  two  (in  general  unrelated  and  not  real)  complex 
numbore  requires  four  real  multiplications.  In  case  of  multiplication  of 
a complex  number  by  its  conjugate,  the  number  of  real  multiplications 
required  is  two.  The  number  of  multiplications  required  to  calculate 
the  diagonal  elements  (in  the  real  case)  is  ^ n(n-l).  Hence  *m(n)  - 

4[m(n)  - i n(n-l)]  + 2[^  n(n-l)) , which  yields  the  desirod  result. 


Corollary.  If  A is  hermitian  positive  definite,  th*-'  ‘•.he  number  of 
operations  required  t.o  compute  S such  that  *S*S  ~ A is  lee?  than  half 
that  required  to  compute  S such  that  ^S'S  - f(A). 

Proof.  Let 


(a) 

(a) ' 

(b) 

(b)  • 

(c) 

(c) ' 


—X 

m(2n)  ♦ m (2n) 

#m(n)  + •*m“'L(n) 

* ~ \ *-1/  — \ 
a \/xi)  ♦ a 

*a(n)  *a”^(n) 

d(2n)  * d”1(2n) 

*d(n)  + *d_1(n) 


| n(2n-l)(2n^l) 
j n(2n-l)(r.-l) 
j n(2n-l)(4n-l) 

j n(n-i)(4n-5) 

, 2 
4n 

n(2n-l). 
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It  is  readily  seen  that 

(a) ’  <|  (a) 

(b) '  <|  (b) 

(c) '  < \ (c). 

It  is  also  clear  that  the  number  of  square  roots  to  be  taken  is  2n 
in  the  real  case  and  n in  the  complex  case. 

7.  Miscellaneous  remarks 

1.  If  \ is  a real  eigenvalue  of  A with  eigenvector  z - x ♦ iy  / 
0,  then  \ is  an  eigenvalue  of  f(A)  with  linearly  independent  eigenvectors 

since  Az  « \%  implies  f(A)*f(z)  - Af(z),  It  may  be  noted 

that  x ♦ iy  and  -jr  ♦ ix  are  linearly  dependent  (over  the  complex  numbers), 

2.  A computing  technique  to  solve  Az  » g with  hermit iar.  positive 
definite  A may  be  based  upon  the  following  equations 

*S*Sa  • g 

Sz  ■ k where  k ■ *S~^  g. 


which  yields  the  formulas  for  z^: 


C *ut\  - ki- 


Y.'  °n-l,n-li‘n-l  * 8n-lzn 


kn-l'  etC‘ 


Thus  5 z„  ■ 

nn  n 

The  formulas  for  computing  S and  k are  given  by  (9)  where  the  last 
column  (from  left  to  right)  of  S plays  the  .role  of  k. 

3.  It  should  be  noted  in  a computation  based  upon  theorem  4, 
a need  not  be  calculated. 

A variant  of  theorem  4,  frequently  convenient,  is  obtained.  by 
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replacing  -g  by  g,  -^g  by  ^g,  -k  by  k,  -^k  by  ana  replacing  1 by  -1. 
y remains  unchanged  and  Ay  - g. 

4.  A computation  based  upon  remark  3 rather  than  remark  2 is  more 
economical  when  the  weights  of  the  unknowns  are  desired  since  the  weights 
are  the  diagonal  elements  of  a"'l  (excluding  -1),  S”  is  calculated,  and 

A ^ » S ^ If  the  weights  are  not  desired,  a computation  based 

on  remark  2 is  more  economical. 

5.  It  is  frequently  desirable  to  "scale"  the  r x s matrix  of 
observational  equations 

(a)  Me  ^ w. 

This  is  accomplished  by  considering  instead  of  (A) 

(D)  MD2  * c*w, 

where  D is  an  s x s diagonal  matrix  and  c is  a real  number.  The  normal 
equations  corresponding  to  (B)  are  - D**M*cw  ■ cD**Mw  or 

(C)  DADZ  - cDg 

vrhers  A • *M*M  and  g - *M*w.  The  solution  to  (C)  is 

z - D”^'A”^D  ^*cDg  - cD  ^•A~^g 

so  tnat 

z “ eD”^z 
Or 

z “ c”^D»Z. 

6.  If  we  define  then  A - S © S,  whence  the 

name  "square  root  method".  Gf.  references  1 and  2. 
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7.  Concerning  theorem  4,  a convenient  order  of  computation  is 


all>  s12’  *22'  *13'  a2'1*  S33'  *"**  After  i®  computed,  it  displaces 
in  memory  (the  real  part,  of  s4  4 displacing  the  real  part  of  a4  4 and 


U 


the  imaginary  part  of  displacing  the  imaginary  part  of  a^j)*  Compar- 
ing (?;,  one  notes  that  each  quantity  required,  to  compute  s4  is  in 

■**  J 

storage  at  the  time  that  s^  is  being  computed. 

Similarly,  a convenient  order  of  computation  for  t^j  is  t^,  t^2> 

1 22 > t23>  ^33*  ****  After  t^j  is  computed,  it  displaces  in 

memory.  Comparing  (21),  one  r.ctss  that  each  quantity  required  to  compute 
is  in  storage  at  the  time  that  is  baing  computed. 


3,  If  H is  hermitian  positive  definite  and  H ■ *S»5,  then 

f(H)  “ ^f(s) • f(S) , but  f (3)  is  not  triangular.  The  economy  of  working 

within  the  complex  field  can  be  attained  working  in  the  real  field  if  one 
seeks  a decomposition  for  f(H)  of  the  above  form  rather  than  a triang-.  lar 
decomposition.  The  triangular  decomposition  does  not  make  use  of  the 
special  form  of  f(H). 


9.  If  A is  a symmetric  matrix  and  ScAx  - 0 for  all  real  x,  then 
A - 0.  For,  taking  x to  be  the  column  matrix  with  1 in  the  ith  position 
and  zero  elsewhere  yields  ScAx  ■ a^  - 0.  Taking  x to  be  the  column 


matrix  with  1 lit  the  ith  and  jth  positions  and  aero  sio  awiioio  yields 
'xAx  ” a^  ♦ 2a^j  ♦ ® which  justifies  the  assertion. 

If  H is  a hermitian  matrix  and  **H*  * 0 for  complex  n x 1 matrices 


5,  then  x f(H)  x ■ 0 for  real  2n  x 1 matrices  x.  It  follows  that 


f(H)  “ 0.  Hence,  H ■ 0. 


10,  Any  complex  matrix  A may  be  written  as 

^ * iH2 


id 
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where  H,  « - (A  ♦ *A)  and  H-  » 77  (A  - *A)  are  herrnitian.  If  *zk% 

1 jC  *_ 

is  real  for  all  z,  then  *zH^z  + i^zH^a  is  real.  E(y  footnote  4,  *zH^p 
and  -^zf^z  are  real.  Hence  ^zH^z  » 0 for  all  z and  - 0.  Thus,  if 
*zAz  is  real  for  all  z,  then  A is  herrnitian.  A fortiori,  if  A is  positive 
definite  over  the  complex  field,  it  is  hermitian.  In  particular,  if  a 
real  matrix  is  positive  definite  over  the  complex  numbers,  then  the  matrix 
is  symmetric. 

There  exist,  however,  non-symmetric  real  matrices  positive  definite 

■ (§  3 


is  oositive 


over  the  real  numbers.  For  example,  a i)  * a i) 
ie  positive  definite  over  the  real  numbers  since  f 2 l\ 

V 1 1) 

definite  and  for  all  skew-symmetric  matrices  Q,  ^xQx  » 0 for  all  x. 

If  a real  non-symmetric  matrix  is  positive  definite  over  the  real 
numbers,  it  is  not  positive  definite  over  the  complex  numbers- 


11.  If  U la  a unitary  matrix,  i.e. , *U*U  - I,  then  f(U)  is 

orthogonal  since  f { *U * U ) - l'f(U)*f(U)  • I. 

M A \ 

12.  It  is  well  known  thatvxu;  if  H is  a hermitian  inatrix,  tnen  there 

exists  a unitary  matrix  U such  that  *U*H*U  is  diagonal.  Application  of  f 

yields  that  ^f(U) »f(H) *f(U)  is  diagonal  with  f(U)  orthogonal.  Thus  the 

eigenvalues  of  f(H)  are  precisely  the  eigenvalues  of  H with  doubled 

1 2 

multiplicity.  In  particular,  it  follows  that  jf(H)|  - J H j . 


(10), 


ri  • 


llalmos.  Finite  Dimensional  Vector  Spaces,  p.  129. 
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Ithaca,  New  York 
1 Attn:  W.R.  Sears 

VIA:  ONR 

Indiana  University 
Bloomington,  Indiana 
1 Attn:  T.Y  . Thomas 

VIA:  Ass't  InsMat 

Massachusetts  Institute  of  Technology 
77  Massachusetts  Avenue 
Cambridge  39,  Massachusetts 
l Attn:  Prof.  Eric  Reiasner 

VIA:  InsMat 

Stanford  University 
Stanford,  California 
1 Attn:  R.J.  Langle 

VIA:  Ass't  InsMat 

Case  Institute  of  Technology 
Cleveland,  Ohio 
1 Attn:  Prof.  G.  Kuerti 

VIA:  ONR 


NOTICE:  WHEN  GOVERNMENT  OR  OTHER  DRAWINGS,  SPECIFICATIONS  OR  OTHER  DATA 
ARE  USED  FOR  ANY  PURPOSE  OTHER  THAN  IN  CONNECTION  WITH  A DEETNTTELi'  RELATED 
GOVERNMENT  PROCUREMENT  OPERATION,  THE  U.  S,  GOVERNMENT  THERE3/  INCURS 
NO  RESPONSIBILITY,  NOR  ANY  OBLIGATION  WHATSOEVER;  AND  THE  FACT  THAT  THE 
GOVERNMENT  MAY  HAVE  FORMULATED,  FURNISHED,  OR  IN  ANY  WAY  SUPPLIED  THE 
SAID  DRAWINGS,  SPECIFICATIONS,  OR  OTHER  DATA  IS  NOT  TO  BE  REGARDED  BY 
IMPLICATION  OR  OTHERWISE  AS  IN  ANY  MANNER  LICENSING  THE  HOLDER  OF.  ANY  OTHER 
PERSON  OR  CORPORATION,  OR  CONVEYING  ANY  RIGHTS  OR  PERMISSION  TO  MANUFACTURE 
USE  OR  SELL  ANY  PATENTED  INVENTION  THAT  MAY  IN  ANt  WAY  BE  RELATE  D THERETO. 


